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Abstract — The goal of traffic management is efficiently utilizing 
network resources via adapting of source sending rates and routes 
selection. Traditionally, this problem is formulated into a utiliza- 
tion maximization problem. The single-path routing scheme fails 
to react to instantaneous network congestion. Multi-path routing 
schemes thus have been proposed aiming at improving network 
efficiency. Unfortunately, the natural optimization problem to 
consider is concave but not strictly concave. It thus brings a 
huge challenge to design stable multi-path congestion control 
algorithms. 

In this paper, we propose a generalized multi-path utility max- 
imization model to consider the problem of routes selection and 
flow control, and derive a family of multi-path dual congestion 
control algorithms. We show that the proposed algorithms are 
stable in the absence of delays. We also derive decentralized 
and scalable sufficient conditions for a particular scheme when 
propagation delays exist in networks. Simulations are imple- 
mented using both Matlab and NS2, on which evaluation of the 
proposed multi-path dual algorithms is exerted. The comparison 
results, between the proposed algorithms and the other two 
existing algorithms, show that the proposed multi-path dual 
algorithms with appropriate parameter settings can achieve a 
stable aggregated throughput while maintaining fairness among 
the involved users. 

Index Terms — Dynamic routing, flow control, stabUity, scalable 
TCP. 

I. Introduction 

The Transmission Control Protocol and the Internet Pro- 
tocol, known as TCP/IP, are widespread for guiding traffic 
flows in the Internet. In a packet-switch network, a route is 
computed and selected to send packets from a source user 
to a destination user, and the sending rate is determined by 
TCP. Traditionally, a single-path routing scheme is deployed, 
where the shortest path is chosen by IP routing in terms of 
hop count or distance, and the flow rate is varied according 
to congestion level along that path. Ideally, both routes and 
flow rates should be guided to guarantee the efficiency and 
fairness in link bandwidth utilization. There thus has long 
been a desire to direct routes selection and rates variation 
according to congestion level. However, studies, e.g. llT4l . have 
shown that making paths selection consistent with congestion 
level may result in network occlusions and routing instability. 
Despite that IP routing is highly scalable, the static or single- 
path routing scheme fails to react to instantaneous network 
congestion. 

Motivated by the applications in ad-hoc networks and 
overlay TCP, recently there have been more interests in 
multi-path routing scheme II2TI ||22|. In that scheme, packets 
belonging to the same source-destination pair are transmitted 
along several routes between them instead of a single path. 



Notice that these routes might not be disjoint. In order to 
take advantage of multi-path routing scheme, network users 
prefer to select the best path among the available routes in 
terms of high throughput or low latency. However, Wang et 
al. |T5l has shown the instability arose from such interaction 
between network users and providers, causing barriers to the 
deployment of this dynamic routing scheme in packet-based 
networks. 

Many researchers devote to find a protocol that can be 
implemented in a decentralized way by source and routers, and 
controls the system to a stable equilibrium point which satisfies 
some basic requirements: high utilization of resources, small 
queues, and a degree of control over resource allocation. All 
of these are required to be scalable, i.e., hold for an arbitrary 
network, with possibly high capacity and delay. 

A major difficult for the multi-path congestion control is 
that the natural optimization problem to consider is concave 
but not strictly concave. It makes that there are possible 
existence of multiple equilibriums. Thus, researchers resort to 
the duality of the primal problem. One attractive consequence 
of the dual algorithm is that they naturally have equilibrium 
points which make full use of the limited bandwidth available, 
while still achieving a notion of fairness between users. Voice 
||20| is the first considering the stability of multi-path dual 
algorithm. The method that extended a single-path result to 
the multi-path case was used in flE] for a primal congestion 
control algorithm. However, the fairness among different users 
is not well considered in ll20l . 

In this paper, we propose a generalized multi-path utility 
maximization model, which is strictly concave and ensure 
equilibria satisfying desirable static properties. Then we derive 
a family of multi-path dual congestion control algorithms. We 
show that the proposed algorithms are stable in the absence of 
delays, based on which we derive decentralized and scalable 
sufficient conditions for a particular scheme when propagation 
delays exist in the networks. 

The main contributions of our work can be stated as follows: 

1) We propose a generalized multi-path utility maximization 
model, which can reduce to specific models with different 
parameter settings. A family of multi-path dual congestion 
control algorithms derived from the above model can both 
fully utilize resources under limitation and achieve stability 
in the presence of propagation delays in network, while 
maintaining fairness among different users. 

2) We implement both rate-based and window-based simu- 
lations respectively using Matlab and NS2, respectively. To 
validate the efficiency of the proposed algorithms, a compar- 



ison is made between the proposed algorithm and the ones 
in fTSl and f20l under NS2. Resuhs show that the proposed 
muhi-path dual algorithms outperform the later ones in optimal 
and stable aggregated throughput under an appropriate value 
of the average window size. 

The remainder of this paper is organized as follows. Related 
work is briefly reviewed in Section |Il] In Section Hill we 
present the proposed multi-path utility maximization model. 
Both stability in the absence of delays and in the presence of 
delays are exhibited in Section HVl and Section |V] respectively. 
Following that is the simulation results in Section |VI] This 
paper is finally concluded in Section IVIII 

II. Related Work 

In recent years theoreticians have developed a framework 
that allows a congestion control algorithm such as Jacobson's 
TCP to be interpreted as a distributed mechanism solving a 
global optimization problem: for reviews see [41 and [6 |. The 
framework is based on fluid-flow models, and the form of the 
optimization problem makes explicit the equilibrium resource 
allocation policy of the algorithm, which can often be restated 
in terms of a fairness criterion. And the dynamics of the fluid- 
flow models allow the machinery of control theory to be used 
to study stability, and to develop rate control algorithms that 
scale to arbitrary capacities. The equilibrium and dynamic 
properties for the related congestion control algorithm based 
on this framework are summarized in Table |I] 

These algorithms can be classified into two major groups, 
i.e., primal algorithms and dual algorithms. In general, the 
equilibrium point of the algorithm solves the primal (or 
original) problem, an approximation problem or the relaxed 
problem (where the capacity constrain is replaced by penalties) 
respectively |4|. 

For the single-path case, Vinnicombe 1 10 1 derived decentral- 
ized and scalable stability conditions for a fluid approximation 
of a class of Internet-like communications networks operat- 
ing a modified form of TCP-like congestion control. Dual 
algorithms are classed two groups, i.e. delay-based and fair 
dual algorithm [12|. The delay -based dual algorithms allowed 
a natural interpretation of the link price as either a real or 
virtual queueing delay (4], fT|, f9l, fTT). It was, however, 
difficult to reconcile fairness with stability. Kelly |12| design 
a class of fair dual algorithm, which can achieve weighted a- 
fairness, and have straightforward delay and stochastic stability 
properties . 

In multi-path case, there are possible existence of multiple 
equilibriums because that the natural optimization problem 
to consider is concave but not strictly concave. Meanwhile, 
when one attempts to use a duality approach, the dual problem 
may not be differentiable at every point To circumvent 
these difficulties, Lin et al. ifTTl used ideas from proximal 
point algorithms. Han et al. |fT9l modified the utility function 
to ensure a unique equilibrium point and generalized the 
algorithm for the case of single -path |10 | to multi-path. Kelly 
at al. ITSl improved on the results obtained by Han et al. 1(191 . 
and present an algorithm with a sufficient condition for local 



stability that is decentralized in the stronger sense that the 
gain parameter for each route is restricted by the round-trip 
time of that route. However, the majority of above research 
focuses on extensions of the primal algorithms proposed by 
Kelly et al. |4|, a class of single-path primal congestion 
controls. The primal algorithms exhibit a trade-off between 
rate of convergence and bandwidth utilization at equilibrium 
since that the desired equiUbrium point only solves the relaxed 
problem. 

III. A Generalized Multi-path Utility 
Maximization Model 

First we will give the network model and propose a gen- 
eralized multi-path utility maximization model. Then approx- 
imation error and dual problem of the generalized model will 
be presented. 

A. Network Model 

We suppose that the network comprises an interconnection 
of a set of sources S, with a set of resources J . Each source 
s G identifies a unique source-destination pair Associated 
with each source is a collection of routes, each route being 
a set of resources. If a source s transmits along a route r, 
then we write res. For a route r, we let s(r) be the (unique) 
source such that r G s(r). We let "R, denote the set of all routes. 
In the following, we use notations 5, J and R to denote the 
cardinalities of sets 5, J and 72. respectively. 

In our model, a route r has associated with it a flow rate 
Xrit) > 0, which represents a dynamic fluid approximation 
to the rate at which the source s{r) is sending packets along 
route r at time t. 

For each route r and resource j G r, let Trj denote the 
propagation delay from s{r) to j, i.e. the length of time it takes 
for a packet to travel from source s{r) to source j along route 
r. Let Tjr denote the propagation delay from j to s{r), i.e. time 
it takes for congestion control feedback to reach s{r) from 
resource j along route r. In the protocols to be considered, a 
packet must reach its destination before an acknowledgement 
containing congestion feedback is returned to its source. 
Further, we assume queueing delays are negligible. Thus for 
all j G r, Trj + Tjr = Tr, the round trip time for route r. 

The notation a = (&)+ denotes that a ~ b if c > and a ~ 
max(0, 6) if c = 0. We abuse notations to use Hx^H j. to denote 
1 

(Ere.^r)^ and to use ||A^||i_p to denote {EresK''')~ 
for any p > 1 and q > I such that ^ + ^ — 1. 

B. A Generalized Multi-path Utility Maximization Model 

A utility function Us{ys) is associated to each source ,s G S, 
which is an increasing, strictly concave and continuously 
differentiable function of ijs over the range ys > 0. And 
UsiVs) oo if j/s ^ oo- As an example, suppose that 

uM)-h'f=^' (2.1) 

for Ws > 0, a > 0, so that the resource shares obtained by 
different sources are weighted a-fair (51 . When Ws = 1, s G 5, 



TABLE I 

Equilibrium AND dynamic properties for congestion control algorithms 



Algorithms 


Single-path Case 


Multi-path Case 


Primal algorithms 


Dual algorithms 


Primal algorithms 


Dual algorithms 


Global Stability" 


141* 


|4|f, |7|t, |9|T, |ll|f 




\4'\^. |17|f, |20|? 


Local Stability" 


|4|*, llOlf 


\4\f, |8|T, |12|T 


|18|^ iigi'* 


1201* 



and * denote the equilibrium point solving the original problem, the approximation problem and the relaxed problem respectively 
and " denote the stability in the absence of propagation delays and the one in the presence of propagation delays respectively. 



the cases a 0,a — 1 and a ^ oo correspond respectively 
to an allocation which achieves maximum throughput, is 
proportionally fair or is max-min fair |5|. TCP fairness, in the 
case where each source has just a single route, corresponds 
to the choice a — 2 with Ws the reciprocal of the square 
of the (single) round trip time for source s |6|. Define the 
demand function Ds{Xs) = {U!,)~^{Xs), a continuous, strictly 
decreasing function. The demand functions derived from the 
class of utility functions defined in ( 12. Il l is 

D,{X,) = (j^^ ' . (2.2) 

For the convenience of making analysis, first we introduce 
routing matrix to succinctly express the relationships between 
routes and resources. Let Ajr = 1 if j G r, so that resource 
j lies on route r, and set Aj^ = otherwise. This defines a 
0-1 matrix A = {Ajr,j G J^,r G TZ). The aggregate rate 
for sources s is Us = J2res ^r- Since we wish the total 
network utility to be high, it is desirable for a congestion 
control algorithm to asymptotically solve the classical Kelly 
formulation: 

maximizex>o J2 ^siY^res^r) 

" ses ^ (2.3) 

subject to Ax < c, 

where c = {cj , j G J') with Cj being the capacity of resource 
j. Note, even if Us is strictly concave, the whole objective 
function is not, due to the linear relationship in J^res ^s- 

A generalized model for the multi-path utility maximization 
problem (12.3b is to 

maximizex>o J2 ^s{ui) 

1 1 

subject to Us < 7 E a^' + (1 - l)ys ,^ 

r£s (^■'^■) 

r(Es 

Ax < c, 

where 7 G [0, 1] and q > 1. Given q > 1, (I2.4l l reduces to 
the one proposed by Voice in ll20l with 7 = 1 and to ( I2.3l l 
with 7 = 0. The motivation for such formulation is that (12.4) 
can reduce to the classical Kelly formulation ( 12.3b and the 
one in ll20l under different parameter settings. The advantages 
of formulation (12.4b are two folds, we can not only provide 
a direct insight into the reason for the stability of the dual 
congestion control with respective to previous work in [4 1 and 
Q, but also avoid choosing sufficient large parameter p to 



approximate ( 12.3b with respective to the work in ||201 . which 
implies large risk of numerical instability. 

To ensure that the objective function is strictly concave, 
we make Assumption H: For each s G S,uj^^U!,{uj) is a 
strictly decreasing function of Ug. This is true for the weighted 
a— fairness utility function (12.1b if an appropriate p is chosen, 
such as ap > 1, where p > 1 and - + - = 1. 

C. Approximation Error 

To solve the non-strict concave of the objective function in 

(12.3b with X, only the 7 fraction of the - power of aggregate 

' 1 

rate = J^res is substituted by X^res problem 
( 12.4b . We can bound how far the solution to (12.4b is from 
maximizing aggregate user utility. 

Lemma 1 (Approximation error): Let (x',y') be any opti- 
mal solution to ( 12.3b . and (x, y, u) be the optimal solution to 
([Z4] |. We have 

Y.Us{Y.<) ^Y.MY.-r) (2.5) 

se5 r£s s£S res 

and 

s£S rGs sG5 rGs 

where error factor = (7|s|p + (1 — 7))'' and \s\ denotes 
the number of route serving for source s. 
Proof: It's obvious that (x, y) is feasible for (12. 3b . So the 
inequality (12. 5b is followed by the optimality of (x',y') to 

For p > l,q > 1 and i + i = 1, we have J^res^r < 

1 i P V 

s|p(^j.g^Xr)'' with the famous Holder inequaUty (|3l. 
Combining it with the facts that Us — jj^res^r + (1 — 
l)iJ2res^r)'^ and increasing, we have 

e-y Xr > u^. (2.7) 

Now let u'g = TSres^r' + (1~ 7)2/3'- ^^'^ obvious that 
(x', y', u') is feasible for ( 12.4b . By the optimality of (x, y, u) 
to ( 12.4b . we have 

f/.K) > f/.«')- (2.8) 

Since is a subadditive function and (•)' is increasing, we 
have 

<'>^2:; (2.9) 



for y'^ = J2res K- Combing the inequalities dZTl ). ^M, ^3 
and the fact that Us{-) is increasing, we get the desired result 
(IB . ■ 

Remark 1: It can be verified that e-y = (l + 7(|s|p — 1))''. 
The error factor is increasing with 7 G [0, 1]. And the facts 
that eo = 1 and ei = hold. So e~, G [l,|s|~] for 

given p > 1. The lemma 1 in |20| is a special case of Lemma 
1 here with 7 = 1. 

D. Dual Problem of the Generalized Model 

Given vectors and f, let A = A^/x. The Lagrangian of 
<I23 is [Usiufj -J2i^r~ Vs)xr - VsVs] + c^/^- For any 

s r^s 

s e 5, we 

maximize Us{u'^) — (■^r — Vs)xr — VsTJs 



subject to Us < J Y + (1 — 7)j/s 



(2.10) 



where x" = {xr,r G s) is the rate vector for source s. 
We denote the optimal objective function value of (12.10b by 
Ws{X'' , I's)- It can be verified that Ws{X'',i's) is finite only 
if Xr — I's > for all r G s and I's > 0. Otherwise, 
Ws{X^,i^s) — +00. In the following derivation, we assume 
Xr > > for all r G s and s G S. 

The Karush-Kuhn-Tucker condition HI for (12.101) is 

gC/^Owr 1 - 77, = (2.11a) 

-fiTjs/q)xr^ -{Xr-i^s) = 0, rGs (2.11b) 

(l-7)(?7,/g)y;^ -t/, = (2.11c) 

Us =7^x1 +(l-7)y|. (2.1 Id) 



Let = Us, i.e., Us — Us ■ By ( 12. Hal ), we have 

T^s/q^U's[ys)vS. (2.12) 
By ( I2.11bl ) and ( 12.1 Icl ), we get 

(1 — ^\n„ I a 

(2.13) 



Xr - I's ' K 

Substituting ( 12. 13b into ( 12.1 Idb . we obtain 

r^s 

Plugging < I2.12I ) into this equation, we get 

u'siys) = (7^||A^ - ^^.11}:^ + (1 - ly^^l-^)^- 

Then, by the definition of the demand function (12.2b . we have 

ys = Ds[{jP\\\^ ~ i^sWlz; + (1 - iri^l-")^). (2.14) 

By (irT2l) . we obtain (Tyjg)^ = ysU's(ysY. And by (|2J3, 
we have that Xr = Vr G 7?. and ys ~ 



defined in ( 12.141 ). 

Finally, the Lagrangian dual problem of (12. 4b is 



mmimize^>o y 

ses 



W^,(A^i/,) + cV 



(2.15) 



The control laws that we will propose can be viewed as 
decentralized dual algorithms to solve problem (12.15b and the 
primal problem (12.4b simultaneously. 

IV. A Large Family of Multi-path Dual Congestion 
Control Algorithms 

In this section, we will derive a large family of multi-path 
dual congestion control algorithms from the generalized multi- 
path utility maximization model. The stability with the absence 
of delay will be stated later 

A. Multi-path Dual Congestion Control Algorithms 

In Section |III1 a generalized utility model have been for- 
mulated, which can reduce to specific models with different 
parameters. We are now in a position to state a family of 
multi-path dual algorithm, which can be described as follows. 

For all resources j 

d 

for some positive function kj, and for all sources s, 

^^I^s{t) = l^si'^sit)){ys{t) -J2xr{t)) (3.2) 

for some positive function Kg, where 



(3.1) 



jer 



Xr{t) = ys(r){t) 



lU's(^r)iys(r)[t))Y 



(3.3) 



ys{t) =ys{t) 



K{t) - l^s{r){t) J 

{1 ^ ^)U's{ys{t))Y 



j6r 



(3.4) 



and 

ys = Ds({Y\\y{t) - VsmlZl + {l~iYvs{tY-^)^^). 

(3.5) 

Theorem 1: Let (/x, u) be an equilibrium point of the system 
(imi-(ll2]i. and let (x,y,y) be defined through (l33Ti-(l33Tl. 
Then (/i, u) solves the dual problem ( 12. 15b . And (x, y, y « ) is 
unique and solves the primal problem (12.4b . where y 9 denotes 

{yhs^s). 

Lemma 2: Let > and A = A^/x. Then the ob- 
jective v) of ( 12.151 ) is differentiable with derivative 



dW 



„ Vj e J, and 1^ = E 



where Zj = Yjer ^r,Xr = Vsi^^^f^Y.Xr = T, jer 1^3^ 

ys = y^{il^2ElMAy and ys is defined by dOl ) Vs G S. 



Proof: The objective function of jlAj is strictly concave; 
hence, the objective function W{fi, v) of (12.151 1 is convex 
and differentiable with — Cj — Zj, Mj G J, and 

1^ = Hres^r - Vs, Vs g S, where Zj = Y^jer^r and 
(x, y) solve problem (12.101 1 |1|. By the definition of the 
system (|3.1| l-( l33] l. we get the desired results. ■ 



B. Global Stability 

Assume that the matrix A has full row rank and u1^^U!,{uj) 
is strictly decreasing. This condition and Assumption H are 
sufficient to deduce that the system (I3.1b -( I3.5I ) has a unique 
equilibrium point. The first is the general assumption to make 
sure the unique equilibrium point when analyzing the dual 
congestion control algorithms, such as |l9], 1121 and |20|. Note, 
the assumption is needed only for the links that would be a 
bottleneck; so our assumption is quite generic. Following is 
the first main result of this paper with a strict proof, where 
the proof is completely different from the heuristic one given 
in 1201. 

Theorem 2: Given the system defined by ( I3.1b -( I3.5I ). Then the 
unique equilibrium point {fi*,iy>*) is globally asymptotically 
stable. 

The proof of Theorem |2] can be found in Appendix. 

V. Delay Stability 

As transmission delay universally exists in network envi- 
ronment, in this section we will present a particular scheme, 
where the proposed algorithms can achieve stability in the 
presence of propagation delays. 

A. Choice of Scheme 

When we include propagation delays, we get the following 
algorithms, for which we can provide scalable, decentralized 
stability conditions. 

For all resources j, 



= ^{J2.At ~ T.,) - c,);^(, (4.1) 



dt 



for some positive constant kj, and for all sources s, 

l^^(t) ^ !^^{y,{t) - Vx.(t - Tr)), (4.2) 

res 



(4.3) 



for some positive constants Kg and ps, where 

\Xr{t) - Vs{r){t)^ 



(4.4) 
(4.5) 



and 

jer 

Compared with (I3.1b -( l3.5b . we set Kjfj,j{t)/p and KsVs{t)/p 
as the dynamic gain factor for resource j and source s 
respectively. In addition, we relax the algebraic equation ( 13.5b 
to differential equation (14.3b for the existence of delay. 

We first give some properties of the equilibrium point, which 
are useful in the proof of the main result. 

Lemma 3: We have as := ^jfrj^ ^ > 0, where tJs = 

ul. 

Proof: We have bg :— {ul^^Us{u1))' < for we suppose 
Assumption H holds. It can be checked that 

bs - (q - l)ur^U'M) + qUs^'-'^U'Xy,) 

Combining it with U'g{ys) nonnegative by Us{ys) concave 
with ys, we get the desired result. I 

Lemma 4: Let (//,, i/,y) be an equilibrium point of system 
(|4TT]|-(|43]) and (x, y, A) defined by (I4r4l)-(l43ll. Then for each 

7' G 7?. we have that 



y" U', . ^''('') 
^s(r) s\ 



and 



1 



^s(r) s{r) 



Mi 



< 



(4.7) 



(4.8) 



Proof: Firstly, we have Xr — j/s(r) by ( 14.41 

Then power the bothside of this equation with 1 /p, we get 



lK{r)iys{r)) 



r ^s{r) 



(4.9) 



Multiply ( 14. 9b with x^'^ and combine the fact 1/p+l/q— 1, 
we have the equation (14.7b . 
Similarly with (14.9b . we have 

i _i [l-l)U'^(^r)iys{r)) 

ykr) = ykr) vvi ^^-^^^ 

from (|4.5b . Combine ( |4.9b with ( 14. 10b . we get 



K-Vs[r) 7 \ys{r) 



Combining it with Xr < ys, we have 



< i - 1. Then 



1 



— 7 



T- 



"sir) , A,- 



B. Main Result 

We now turn to our main concern, the local stability of the 
system (14311 -(I4r6b. 

Define a link j to be almost saturated if at which both 
/ij = and condition 

^ Xr= Cj,j e J (4.11) 

holds. We thus rule out the possible degeneracy that both terms 
in the product ( 14. It might vanish. 

Theorem 3: Let (/i,, u, y) be an equilibrium point of system 
( 14. Il l-( l4~6b with no almost saturated links, and suppose that for 
all J e J, 

Kj'^XrTr < (4.12) 

jer 

and for all s E S, 

K,Y,''rTr<lj (4.13) 



and 



(4.14) 



Then there exists a neighborhood Af of fi such that for any 
initial trajectory ((/x(t), u{t),y(t)), t e (-T^ax, 0)) with fi{t) 
lying within the neighborhood J\f, {fj,{t),v{t)) converge as 
t — ?► oo to the solution (/x, f) to the optimization problem 
( |2.15t and {x{t),y{t),y{t)'^) converge as t — > oo to the 
solution (x, y,y9) to the optimization problem (12.4b . where 
T^max = max(rr, r eU). 

The proof of Theorem |3] can be found in Appendix. 

C. Result for a-fair Utility Function 

Corresponding to weighted a-fair utility function, defined 
by equation ( 12. It . the defined in Lemma [3] becomes "^""'^ . 
Then the local stability condition (14.14b reduces to 



Ps[ap - 1) : 



<P- 



Since Us > Vs = X^r res^"" ^"'^ •^'^ ^ conditions 
( |4l2] i. ( |4TT3l l and 



- 1) 



(4.15) 



are sufficient to derive the local stability for this special case. 

These conditions are attractive because they are local and 
decentralized. Let the maximize available rate for source s 
be Ms- They lead to a highly scalable parameter choice 
scheme: each source and link chooses their gain parameters 
to be K, = w^,Ps = (ap-1)T, = 

" " - y x°T,. 

K S (0, j), where — is the average round trip 

time of packets transmitted by source s and Tj — 

is the average round trip time of packets passing through 
resource j. As a desirable feature, the gain parameters in the 



proposed algorithms can be derived from local information 
only. Independence of state information in networks leads 
conditions for delay stability to be scalable and decentralized. 
Remark 2: If 7 = 1, the conditions (14.12b and ( 14.15b reduce to 
the sufficient ones determined by Voice |20| except they use an 
estimation of the average round trip time of packets transmitted 
by source s. The delay stability condition for single-path fair 
dual algorithm given in [12 | has minor difference from these 
condition, which was derived by linearizing the system about 
the flow rate Xr{t). 

VI. Simulation Experiments 

We will further investigate the proposed algorithm by sim- 
ulation experiments, which mainly focus on two aspects: 

a) To evaluate the performance of the proposed algorithm 
in terms of stability and convergence rate. We implement our 
algorithm in Matlab and explore the influence of parameters 
on these two features. 

b) To study the performance of the proposed algorithm in 
network environment. We use NS2 to implement the proposed 
algorithm in a window-based network environment and make 
performance comparison with the other existing two algo- 
rithms. 

In the sequel, we take the utility with the form of ( 12.1b with 
a = 1 and Ws — 1 for all s. 

A. Matlab Simulation 

To really achieve the best tradeoff between stability and 
convergence one has to carefully select a few parameters. 
To make our work really usefully for network designers and 
administers, we provide some discussion and rules of thumb to 
select the values. We use Matlab to implement the proposed al- 
gorithm and investigate how parameters affect the algorithm's 
performance. The network topology used is Abilene backbone 
network, shown in FiglT] (a), which have fourteen 100-Mb/s 
hnks with 2-ms delay. The discussion explain the intuitive 
meaning of changing a parameter in each direction. 

First, we select a set of 7 with fixed values, and vary the 
gains to explore the trade-off between the convergence rate 
and stability; Then, we vary the values of parameter 7 within 
the interval [0, 1], and study how to tune the gains to make 
the system achieve the optimal performance. 
Stability and convergence rate. First, we set p = 2, 7 = 0.2 
and observe how the gains Hj and Kg to trade off between the 
convergence rate and the stability. 

For simplicity, we first fix link gain Kj to be 10^'', and 
study the effect of source gain Kg on system performance. Here 
we run the simulation with three different Ks values 10~^, 
10^^ and lO^*^ respectively. In each simulation we set step to 
5ms and run the simulation for 50s. The results is shown in 
Fig|2] (a), where axis Y represents the aggregate throughput 
of four routes. All simulations with three different parameters 
will achieve global stability roughly at 5s. We notice that, 
however, when — 10^^, the coverage is slightly slow. And 
when Ks = 10"'', there exists big oscillation before stability 
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reaches. It seems that 10~^ is the best choice among these 
three values of Kg- 

And then we fix source gain Kg to be 10^^ to explore the 
influence of link gain Kj on system performance. We run 
simulations with three different kj values lO^'^, lO^"* and 
10~^ respectively. Each simulation runs 50s with step of 5ms. 
The simulation results are illustrated in Figj2] (b), where the 
trends of the aggregate throughput are similar to those in Fig|2] 
(a). Simulation with a larger value of link gain converges 
faster and meanwhile experiences more severe oscillation. 
We notice that, with kj = lO""* and Ks = 10^^, the 
algorithm can achieve a better trade-off between the stability 
and convergence rate. 

Approximation Parameters. In the proposed algorithms. 
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there exist two parameters, p and 7 which control the error 
factor in Lemma 1. As p also exists in the algorithm 
proposed by Voice f2Ql, here we only consider the influence 
of 7 on system performance. 

As shown in Fig|2](b), simulation with link gain Kj — lO^"* 
converges fast, we thus set p 2 and Kj = 10^* in the 
following simulations. We run simulations with 7 varying from 
to 1, and explore how source gain Ks should react to different 
values of 7 in order to achieve the optimal performance. Each 
simulation runs with step = 5ms and lasts for 50s. 

The simulation results exhibit in Fig. |3] From Fig|3](a), we 
notice that parameter 7 will influence the characteristics of 
both convergence and oscillation. Simulation with a smaller 
value of 7 experiences greater oscillation before achieving 
stability. The value of Kg should decrease with the increase 
of 7 to guarantee the simulation converges. Besides, the 
convergence throughput, at which the algorithm achieve global 
stability, is influenced by the choice of 7. Figl3](b) shows that 
a smaller value of 7 will lead to a smaller gap between the 
optimal throughput and the one obtained with the proposed 
algorithm. 

B. NS2 Simulation 

The proposed congestion control algorithm is derived from 
a rate-based model. TCP, however, is a window-based control 
protocol. Now we use NS2 to implement TCP-Reno for further 
investigation. 

The topology used is shown in Fig.l (b). Here we consider 
the case of three source-destination pairs, namely from 1 to 
4, 1 to 2 and 1 to 3, and each link-capacity along the route is 
set to lOOMb/s with a one way propagation delay of 2ms. In 
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simulation, each source-destination pair is attached to multiple 
routes. For example, pair 1 and 2 has two routes, from 1 to 2 
directly and from 1 to 2 via 3. 

1) Stability and convergence rate According to the rate-based 
simulation, we implement the proposed algorithm with the 
parameters shown in Table II, which guarantee the algorithm 
achieving its optimal performance. The simulation lasts for 5 
seconds and 7 TCP connections start at the same time and 
during the whole simulation. 

The performance of the proposed algorithm in terms of 
each source-destination's aggregated throughput and the whole 
network's aggregated throughput is shown in Fig. 4. As is 
shown, the aggregated throughput with the proposed algorithm 
achieves equilibrium at about 1.5s. 

2) Performance comparison with different values of 7 Now 
we vary the values of 7 within the interval [0,1] and achieve 
the optimal performance. Throughput of the three source- 
destination pairs is plotted in Fig. 5 (a) (e), where 7 is set 
to 0.2, 0.4, 0.6, 0.8, 1.0 respectively. 

All the three source-destination pairs can achieve equilib- 
rium after a period of oscillation, however, with different 
approximate aggregated throughput when 7 varies from 0.2 
to 1.0. According to Fig. 6, better consideration of fairness is 
shown when the equilibrium conditions are achieved if 7 
and when 7 — 1, there exists a trade-off among different 
source-destination pairs in terms of aggregated throughput. 
Thus, possibly, we can set 7 to different values to meet 
different demands when facing different situations of the 
network, meanwhile remaining equilibrium conditions. 

Finally, throughput for TCP connections does not make 
sense. Particularly when experimenting with congestion con- 
trol. It counts even re-transmits as useful packets. We measure 
the goodput. Usually goodput can be substantially different 
than throughput when the congestion control makes the win- 



dow oscillate. We would like to know, how our schemes with 
their oscillations cpmpare with the alternatives. 

VII. Conclusion 

This paper considers the well known problem of joint 
multi-path routing and flow control, and brings new insight 
to congestion control algorithms. Specifically, we propose a 
generalized multi-path utility maximization model, and then 
derive a family of muti-path dual congestion control algorithm. 
Based on the results in this paper, one can understand the 
unstability of the natural muti-path dual congestion control 
algorithm which is a special cases in the proposed family. The 
one proposed in ll20l . a special case in this family, is at a risk to 
choose a sufficient large p to approximation the solution of the 
original problem. Simulation results show that the proposed 
algorithm can achieve a more optimal and stable aggregate 
throughput with an appropriate value of the average window 
size than the others multi-path congestion control algorithms. 

Future work is mainly focused on enriching simulation 
experiments of the proposed dual multi-path congestion con- 
trol algorithms. The excellent performance of the proposed 
algorithms in real network environment is the ultimate goal 
we are pursuing. 
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VIII. Appendix 

The proof of Theorem |2] is presented as follows: 
Proof: The proof is based on Lasalle's invariance principle 
applied to a suitable Lyapunov function. Now we introduce 
the candidate Lyapunov function V{fi,iy) — W{fi,iy). For 
any state vector ^'(t)) 7^ {fi*,v>*) of system ( I3.1b -( I3.2I ). 

it can be seen that i^{t)) is feasible for the dual problem 

( 12.15b . For (/X*, I/*) is the unique solution of ( 12.151 ). we have 
W{n,iy) > W{fi*,u*). 

We now take the derivative of V{fj,, v) along trajectories of 
our system: 



v= E 



dW 



dW 



ses dfs 



ys)i's 



= E 



where we have denoted vj := {cj — Zj)fij. Note that the second 
equality follows from Lemma 2. We will now show that Vj < 
for each j. For this, we must apply the dynamic equations 
( I3.1b -( l3^ . and distinguish between the two cases: 

(a) > 0. Here vj = —Kj{pj){zj — cj)^. 

(b) fij ~ 0. Here Vj — Kj{fij){cj — max(0, — cj). 
There are two cases: 

Vj = for Zj < Cj, 

Vj = -Kj{^ij){zj - Cj f for Zj > Cj. 

We thus confirm that Vj < for every j, and thus V < 0. 
Invoking Lyapunov's stability theorem, we conclude that the 
trajectory {^j,{t),v(t)) must remain bounded over time, and 
that the equilibrium point is stable in the sense of 



Lyapunov: trajectories starting close to it will remain inside a 
neighborhood. 

To establish the stronger claim of asymptotic stability, we 
must show that trajectories will converge to equilibrium as 
time goes to infinity. We do this by means of Lasalle's 
invariance principle (see, e.g. \2\). To apply it, we must study 
the set of states (/x, u) where the Lyapunov derivative is zero, 
or equivalently Vj — for each j and ys — Eres ^'-'^ ^^'^^ 
s. Reviewing the cases above, we find that Vj = can only 
happen when either 

(i) Zj = Cj, or 

(ii) Zj < Cj and Hj = 0. 

The Lasalle principle is based on identifying an invariant 
set inside the set {(/x, v) : V = 0}. For this purpose, suppose 
a trajectory fi{t) moves inside this set. Then for each j we 
must have fj.j{t) — /i^, where fjP is the initial state. 

To see this, first note that if /i^ = for a certain j, then 
it must remain this way because Zj — Cj < under both 
alternative (i) and (ii). Using this fact again, now ( 13.1b implies 
that ijj = under both alternatives, so fij{t) = fjj. 

If instead /i" > 0, we are initially in alternative (i) and thus 
fij stays constant fJ,j{t) = /i^ due to ( 13.1b . Then we stay in 
this alternative indefinitely. 

Now we observe that for a trajectory satisfying the 
alternatives (i) or (ii) is the unique equilibrium (/x*, 1/*). ■ 

The proof of Theorem |3] is presented as follows: 
Proof: Initially assume that jjj > for j G J', and thus ( 14.1 lb 
holds for each j e J'. Later we shall see that the assumption 
is without loss of generality. 

Let Xr{t) = Xr + Ur{t),ys{t) ^ Vs + Vs{t), ys(t) = 
ijs +Vs{t),Xr{t) = Xr +Vr{t),Hj{t) = +Wj{t),Vs{t) = 

Vs + Wsit). Then, linearizing the system ( I4.1b -( l4.3b about /x, u 
and y, and using the relation (14.7b . we obtain the following 
equations 



dt 



— Wsit) = 

dt p 



(4.16) 



[vs{t)-Y,Mt-Tr)), (4.17) 



r^s 



+ (l-7)2/s 'Vs{t)-ys "vS)), 



(4.18) 



where 



, . ,.._^EjerWjit-Tjr) Ws{t) 
Ur[t) = -pXr asVs[t) + - 



Vs{t) = -pys asVs{t) + 



and Gs = —jf, — ^ > by Lemma [3] 

Let us overload notation and write Ur{uj),Vs{ij-'),Vs{ij-') 
and Vr{uj),Wj{uj),Ws{oi!) as the Laplace transforms of 



Ur{t),Vs{t),Vs{t) and Vr{t),Wj{t),Ws{t), respectively. We 
may deduce from ( l4.16l l-( l4T8T l, 



P 



res (4.19) 

+ (1 ~l)ys "Vsiuj) -ys "Vsiuj) ] , 



Ur[UJ ) = —pXr asVs{uj) + 6 

jer 



lUs (w) 



By ( 14.191 1, we have 

(w + crs)us(i:j) 



= f [Eres^^^r ^e-^^'-Uriuj) + (1 - 7)^3 ) , 

_ 1^ 

where = PsVs "/p- 
We calculate that 

{ ^^(\ ) = -G^(-) ( 
y w(a;) J \ 

The matrix G{uj) is called the return ratio for (v,w) and 

= (£^^(Eres' 7Xr'e--^^ + (1 - 7)4)^ 

+ (1-7)^),. = 



G 



iS+s){2S+j 



-e 



and all other entries are 0. 

Let G be an (25" + J) x (25" + ,/) matrix with 

and all other entries are 0. It can be verified that 

G(a;) = PY(w)R(-w)'^X(a;)R(w)p-i + G(w), 



where X(a;) is an i? x i? diagonal matrix with entries 

Xrr{t^) = e-'^'^- /{uoTr), Y [uj) is an (25' + J) x (25' + J) 
diagonal matrix with entries Ys's'i'-^) — , , Yss{uj) — 
1, Yjj{uj) = 1, and P is an (25+ J) x (25+ J) diagonal matrix 



with entries P,/ 



,Ps. 



(Kjfij)^ , and R(w) is an i? x (25 + J) matrix where 



and all other entries are 0. Since the open loop system (14. H - 
(I4.3l l is stable, we just need to show that the eigenvalues of the 
return ratio G{uj), for = if?, do not encircle the point —1 
from the generalized Nyquist stability criterion. Now, these 
eigenvalues are identical to those of 

Y(w)R(-w)'^X(w)R(w) + p-^G{uj)P. (4.20) 

If A is an eigenvalue of the G{i6), then we can find a unit 
vector z such that 

Az = Y{ie)Il{i0)*X{ie)Ti{i9)z + p-iG(i6')Pz, 

where * represents the matrix conjugate. Thus 

Az*Y(i6')-iz = z*R(ii6')*X(i6')R(ie')z 

+z*Y(i6')-ip-iG(i6')Pz. 

If A is real, since the real parts of z*Y(i6')^^z and 
z*Y{i9)~^P~^G{i9)Pz are 1 and respectively, we have 

A = Re{z*Ti{i0)*X{ie)Ti{i0)z). 

Let d = R(i6')z. Then, since X is diagonal. 



A 



\dr\^Re{Xrr{iO)) 



iOTr 



Since Re > -f for all 9 EO), and hence A > 

(-2/7r)ivr, where K = ||R(ii6l)z||2. 
Next, we bound K. Let Q be the (2 5 + J ) x (25 + J) 



diagonal matrix taking values Qs's' — 



Q SS \/ 



and Qjj = y Let p{-) denote the spectral radius, and 
the maximum row sum matrix norm. Then 

K = z*R{i6)*R{i6)z 

< p{R.{ie)*R{i9)) 

= p(Q-iR(i6')*R(z6i)Q) 

< ||Q-iR(i0)*R(i0)Q||oo 

< i, 



the last inequality follows from (I^Sl l and (I4.12l l- (l4.14b . 

So we have that A > — 1 for any real eigenvalue A. Thus, 
when the loci of the eigenvalues of G{id) for —co<9<oo 
cross the real axis, they do so to the right of -1. Hence the loci 



of the eigenvalues of G{i9) cannot encircle -1, the generalized 
Nyquist stability criterion is satisfied and the system (I4.1l )-( l4.6l l 
is stable, in the sense that Vs{t) 0,Vs{t) 0,Wj{t) — 
exponentially, for all s,j, as t — > oo. There remains the 
possible that fi{t) might hit a boundary of the positive orthant, 
and invalidate the linearization (I4.16b -( l4.18b . To rule out this 
possibility, note that there exists an open neighborhood of fi, 
say TV, such that fi{t) > 0,t G (— rmaxjO), the linearization 
is valid. Thus Af is as required. 

Finally we shall relax the assumption that fj,j > for all j. 
Since {fi,v,y) be an equilibrium point of system (|4.1| i-( |43| l 
with no almost saturated links, /i^ = implies fij{t) < 0. 
Thus there is a neighborhood of fi, say A^, such that, on 
A4, the linearization of ( I4.1b -( l4.6l l coincides with the case 
where we discard all j such that fij — 0. Therefore, as above, 
we may choose an open neighborhood M <Z M. such that 
for any initial trajectory {{n{t),v{t),y{t)),t e {-T„,i,^,0)) 
with fj,{t) lying within the neighborhood A/", i>'(t)) 
converge as i — > oo to the solution {fi, v) to the optimization 
problem (12.15b and (x(i),y(t),y(t)9) converge as i cx) 
to the solution (x. y, y « ) to the optimization problem (12.4b . I 



